Search for: All records

Abstract Robust quantification of predictive uncertainty is a critical addition needed for machine learning applied to weather and climate problems to improve the understanding of what is driving prediction sensitivity. Ensembles of machine learning models provide predictive uncertainty estimates in a conceptually simple way but require multiple models for training and prediction, increasing computational cost and latency. Parametric deep learning can estimate uncertainty with one model by predicting the parameters of a probability distribution but does not account for epistemic uncertainty. Evidential deep learning, a technique that extends parametric deep learning to higher-order distributions, can account for both aleatoric and epistemic uncertainties with one model. This study compares the uncertainty derived from evidential neural networks to that obtained from ensembles. Through applications of the classification of winter precipitation type and regression of surface-layer fluxes, we show evidential deep learning models attaining predictive accuracy rivaling standard methods while robustly quantifying both sources of uncertainty. We evaluate the uncertainty in terms of how well the predictions are calibrated and how well the uncertainty correlates with prediction error. Analyses of uncertainty in the context of the inputs reveal sensitivities to underlying meteorological processes, facilitating interpretation of the models. The conceptual simplicity, interpretability, and computational efficiency of evidential neural networks make them highly extensible, offering a promising approach for reliable and practical uncertainty quantification in Earth system science modeling. To encourage broader adoption of evidential deep learning, we have developed a new Python package, Machine Integration and Learning for Earth Systems (MILES) group Generalized Uncertainty for Earth System Science (GUESS) (MILES-GUESS) (https://github.com/ai2es/miles-guess), that enables users to train and evaluate both evidential and ensemble deep learning. Significance StatementThis study demonstrates a new technique, evidential deep learning, for robust and computationally efficient uncertainty quantification in modeling the Earth system. The method integrates probabilistic principles into deep neural networks, enabling the estimation of both aleatoric uncertainty from noisy data and epistemic uncertainty from model limitations using a single model. Our analyses reveal how decomposing these uncertainties provides valuable insights into reliability, accuracy, and model shortcomings. We show that the approach can rival standard methods in classification and regression tasks within atmospheric science while offering practical advantages such as computational efficiency. With further advances, evidential networks have the potential to enhance risk assessment and decision-making across meteorology by improving uncertainty quantification, a longstanding challenge. This work establishes a strong foundation and motivation for the broader adoption of evidential learning, where properly quantifying uncertainties is critical yet lacking. 

Abstract. This paper describes and analyzes the Reed–Jablonowski (RJ) tropical cyclone (TC) test case used in the 2016 Dynamical Core Model Intercomparison Project (DCMIP2016). This intermediate-complexity test case analyzes the evolution of a weak vortex into a TC in an idealized tropical environment. Reference solutions from nine general circulation models (GCMs) with identical simplified physics parameterization packages that participated in DCMIP2016 are analyzed in this study at 50 km horizontal grid spacing, with five of these models also providing solutions at 25 km grid spacing. Evolution of minimum surface pressure (MSP) and maximum 1 km azimuthally averaged wind speed (MWS), the wind–pressure relationship, radial profiles of wind speed and surface pressure, and wind composites are presented for all participating GCMs at both horizontal grid spacings. While all TCs undergo a similar evolution process, some reach significantly higher intensities than others, ultimately impacting their horizontal and vertical structures. TCs simulated at 25 km grid spacings retain these differences but reach higher intensities and are more compact than their 50 km counterparts. These results indicate that dynamical core choice is an essential factor in GCM development, and future work should be conducted to explore how specific differences within the dynamical core affect TC behavior in GCMs.